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We construct a configurational entropy measure in functional space. We apply it to several 
nonlinear scalar field models featuring solutions with spatially-localized energy, including solitons 
and bounces in one spatial dimension, and critical bubbles in three spatial dimensions, typical of 
first-order phase transitions. Such field models are of widespread interest in many areas of physics, 
from high energy and cosmology to condensed matter. Using a variational approach, we show that 
the higher the energy of a trial function that approximates the actual solution, the higher its relative 
configurational entropy, defined as the absolute difference between the configurational entropy of the 
actual solution and of the trial function. Furthermore, we show that when different trial functions 
have degenerate energies, the configurational entropy can be used to select the best fit to the actual 
solution. The configurational entropy relates the dynamical and informational content of physical 
models with localized energy configurations. 
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INTRODUCTION 

Hamilton's principle of least action states that out of 
the infinitely many paths x{t) connecting two fixed points 
in time, nature always chooses the one that leaves the ac- 
tion S[x] stationary [1 . This path, as is well known, is 
the solution to the Euler-Lagrange equation of motion, 
obtained from imposing that the action's first variation 
vanishes, SS = 0. As we move from point particles to con- 
tinuous systems, say, as described by a scalar field 4>(x, t), 
Hamilton's principle will generate the partial differential 
equation (or equations, for vector- or tensor-valued fields) 
describing the motion that leaves the action functional 
S[4>] stationary. In this letter, we will explore the rela- 
tion between information and dynamics, proposing an en- 
tropic measure that quantifies the informational content 
of physical solutions to the equations of motion and their 
approximations-the configurational entropy in functional 
space. As we will see, this measure may offer new insight 
into how spatially-localized ordered structures such as 
topological defects emerge in a widespread class of natu- 
ral phenomena, from high-energy physics and cosmology 
[2] to condensed matter [3]. 

To illustrate our point, we will investigate several non- 
linear scalar field models in one and three spatial di- 
mensions that have spatially-localized energy configura- 
tions such as solitons and critical bubbles. After defining 
the configurational entropy, we will compute it for mod- 
els that admit spatially-localized energy solutions such 
as kinks, bounces, and critical bubbles. We will then 
compute the configurational entropy for several ansatze 
that approximate the solutions to the eom with vary- 
ing degrees of coarseness. To compare solutions and ap- 
proximations, we will define the relative configurational 
entropy— a measure of relative ordering in field configu- 
ration space-and show that it correlates well with the 
energy: the coarser the approximation to the solution, 



the higher its energy and its relative configurational en- 
tropy. 

We will also show how the relative configurational en- 
tropy can resolve ambivalent situations where the ener- 
gies of different trial functions are degenerate, thus pro- 
viding an efficient criterion to obtain optimized analytical 
approximations to the solutions of the equations of mo- 
tion, as may be needed in different applications. On the 
basis of these results, we propose that nature is the ulti- 
mate optimizer, not only in extremizing energy through 
its myriad motions, but also from an informational per- 
spective. 



MATHEMATICAL PRELIMINARIES: DEFINING 
THE CONFIGURATIONAL ENTROPY 

Since we are interested in structures with spatially- 
localized energy, consider the set of square-integrable 
bounded functions f(x) G L 2 (R) and their Fourier trans- 
forms F(k). PlancherePs theorem states that [4] 
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Now define the modal fraction f(k), 
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where the integration is over all k where F(k) is defined 
and d is the number of spatial dimensions. f(k) mea- 
sures the relative weight of a given mode k. For periodic 
functions where a Fourier series is defined, f(k) — > /„ = 
l^"| 2 /S l^ra| 2 > where A n is the coefficient of the n-th 
Fourier mode. 

We define the configurational entropy Sc[f] as 
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In analogy with Shannon's information entropy, Ss = 
— ^2 Pi log 2 Piy which represents an absolute limit on the 
best possible lossless compression of any communication 
[5J, we can think of the configurational entropy as pro- 
viding the informational content of configurations com- 
patible with the particular constraints of a given physical 
system. Note that when all N modes k carry the same 
weight, /„ — 1/N and the discrete configurational en- 
tropy has a maximum at Sq = In N. If only one mode is 
present, Sc = 0. These limits motivate the definition of 
Eq. [3j Further motivation is given below. 

For general, non-periodic functions in an interval (a, 6), 
we define the continuous configurational entropy Sc[f] 
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where f(k) = /(fc)//(fc) max and /(fc) max is the max- 
imum fraction, in most cases of interest given by the 
zero mode, k = 0. This normalization guarantees that 
f(k) < 1 for all k. We call the integrand f(k) ln[/(fc)] 
the configurational entropy density. We note that Sc[f] 
is similar to the Gibbs entropy of nonequilibrium ther- 
modynamics, although the latter is defined for a statis- 
tical ensemble with microstates with probability pi — 
exp(— £^i/fcsT)/^exp(— Ei/ksT), where Ei is the en- 
ergy of the i-th microstate and fc^ is Boltzmann's con- 
stant [5 . Note also that the continuous configurational 
entropy can be made dimensionless by dividing it by m d , 
where m is the relevant mass or energy-scale of the sys- 
tem. (We set c= H = 1). 

As an example, consider a Gaussian in d dimensions, 
f(r) = N exp(— ar 2 ), and its Fourier transform, F(k) = 
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The zero mode carries the most weight. Eq. [4] gives 
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In the limit of a very spread-out Gaussian, a — > 0, Sc 
0, while for a highly- localized Gaussian a — > oo, Sc — > 
oo. Sc estimates the information required in fc-space to 
build the function f(x). In fact, defining the dispersion 
of a function f(x) as 



A>(/) 
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we know that for f(x) and F(k) normalized to unity, they 
satisfy the minimum uncertainty relation Do(f)Do(F) — 
1. We thus expect the configurational entropy of a Gaus- 
sian to represent an absolute minimum for spatially- 
localized functions f(x) parameterized by the same spa- 
tial dispersion with one (or more) maxima for x € 
(—00,00). We can thus write, Sc[f] > Sc(ce). 



In physical applications where the function f(x) rep- 
resents a spatially-confined structure (e.g. a </> 4 or a sine- 
Gordon kink [7]), the parameter a or its equivalent de- 
termining the spatial extent of the structure will be re- 
stricted by the relevant interactions or constraints. For 
example, a free particle of mass m confined to a rigid- wall 
box of length 2R has momentum p n = nhn/R. If mod- 
eled by a Gaussian with dispersion a = (2a) -1 / 2 centered 
at R, the uncertainty relation gives a < ir 2 /2R 2 . On 
the other hand, a 2 = (I /2a) < R 2 and so, a > 1/2R 2 . 
We thus have, 1/2 < aR 2 < ir 2 /2. Since 2R cannot be 
smaller than the reduced Compton wavelength of the par- 
ticle, 2R > 2n/m, we get, 1/2tt 2 < a/m 2 < 1/2. 



FREE FIELD IN A BOX 

As another application to motivate our definition of 
the configurational entropy, consider a free massive scalar 
field in a rigid-wall box of size L. Imposing 0(0, t) = 
4>{L, t) — 0, we obtain the familiar quantization of mo- 
mentum modes, k n = mr/L, and dispersion relation 
a; 2 = (rnrc/L) 2 +m 2 c 2 , with n — 1,2.... Further im- 
posing that (j)(x, 0) = 0, the general solution is 4>{x,t) = 
^2 A n sm.k n x cosu) n t, where the coefficients A n are given 
in terms of the initial configuration <f>o(x) = <f>(x,0) as 
A n = (2/L) J Q (fro(x) sm[k n x]dx. Thus, the Fourier am- 
plitudes {A n } determine the contributions from different 
normal modes to a given precision of the series expansion. 
The configurational entropy of a general field profile, ob- 
tained from Eq. [3j is given by 
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If A n — A for n — 1,...,N, then Sc[4>] = IniV, and 
the configuration entropy is maximal, as it should [5]. 
Also, if only a single mode is present, Sc[4>] = 0: the 
most ordered state is a pure state. From an initial 
configuration with a certain Sc^o], the configurational 
entropy will evolve in time as the Fourier coefficients 
A n (t) = A n cosuj n t change. 



CONFIGURATIONAL ENTROPY OF KINKS 

Consider a scalar field model in Id with energy den- 
sity pv[4>] = (4>) 2 /2 + {4>') 2 /2 + V{4>), where the dot 
and the prime denote time and spatial derivative, respec- 
tively. We are interested in situations where the Euler- 
Lagrange equations admit static solutions with localized 
energy density so that the configurational entropy is well- 
defined. That is, the energy density must be square- 
integrable even if the fields aren't. This is the case, for 
example, for the kink solutions for the double-well and 
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for the sine-Gordon potentials [7], which we now examine 
in turn. 



Case 1: Symmetric double- well potential 



If V(<p) = (A/4)(0 2 - to 2 / A) 2 , the kink (or antikink) 
is the static solution interpolating the two minima of the 
potential at m i n = ±(m/\/A) as x — > ±oo, and is given 
by 4*k{ x ) — i(wi/vA) tanh(?na;/v / 2)- The kink's energy 
density is p[4>k]{x) = (to 4 / '2\/A)sech (mx/\/2) and its en- 
ergy is = \/8/3m 3 /A ~ 0.9428to 3 /A. From the Fourier 
transform of the energy density, Eq. [2] gives the modal 
fraction 



/(*) 



357rfc 2 (4a 2 + fc 2 ) 1 
2304a 7 



csch 



2a)' 



(9) 



where a = m/y/2. Using /(A;) = f(k)/f(Q) into Eq. [ZJ 
we obtain the configurational entropy for the 4> 4 kink, 
Sc[<j>k] = 1-2167. To check how this value compares 
to other monotonic configurations satisfying the same 
boundary conditions that approximate the kink we use 
a variational approach. As an illustration, consider 
the function h(x) = (2/tt) tan _1 (aa;) expressed in units 
of m/\/X The energy E[h] is minimized for a c — 
[24C(3)/TT 2 ] 1/2 m ~ 1.7097m. With this value, the energy 
is E[h] — 1.0884to 3 /A and the configurational entropy- 
computed, as for the kink, from the energy density-is 
Sc[h] = 2.412 > Sc[<j>k]- Hence, for this first example, 
we see that the trial function h(x) has both larger energy 
(as it should) and larger entropy than the kink solution. 

Given that we cannot guarantee that any monotonic 
trial function will have lower CE than the solution to 
the eom (see, e.g., Case 2 next), we define the relative 
configurational entropy, ASc [f, g] , which compares the 
configurational entropy of trial functions to that of the 
solution of the eom 



AS c [f,g] = 
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Sc[g] 
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where we take Sc [/] to be the configurational entropy of 
the trial function and Sc[g] that of the solution to the 
eom. This can be used together with a similar quantity 
for the energy to investigate if there is a direct correlation 
between the efficiency of a trial function in approximating 
the solution to the eom and its configurational entropy. 

In Table [I] we show the results for Sc, ASc[f,g], 
and AE[f,g] for the trial function h(x) above and two 
other approximations to the kink solution. We also 
show the value of the extremized variational parame- 
ter a c for each ansatz. In all three cases, the coarser 
the ansatz-in the sense of having larger energy than the 
kink-the larger its configurational entropy and its rela- 
tive configurational entropy. To confirm that ASc gives 
a measure of fitness, we computed the fitting parameter 
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a c [m] 


AE 


ASc 


Sc 


tanh(a:r) 


1/V2 








1.2167 


4tan _1 [exp(aa;)]/7r — 1 


1.1647 


1.3 x 10 -3 


0.0756 


1.3086 


exp[aa;] — 1, x < 
— exp[— ax] + 1, x > 


0.9574 


1.55 x 10~ 2 


0.435 


1.746 


2 tan - [oa:]/7r 


1.7097 


0.1447 


0.9823 


2.412 



TABLE I: Comparison of energy and configurational entropy 
of the d> 4 kink and several trial functions. 



Case 2: sine-Gordon potential 

For another example, varying the Id action with 
the sine-Gordon potential, V s q{4>) — [1 — cos(a<fi)] /a 2 , 
gives the static kink (antikink) solution 4> s g(x) = 
(4/a) tan -1 e~xp[±x/y/a], with energy density p s g[(/>] — 
2 V s g (</>)• Integrating over space we get E s g = 8 /a 2 = 
8m 3 /A. We will set a = 1 from now on. From the 
energy density, we obtain the modal fraction f(k) — 
(3/8)7rfc 2 csch 2 (A:7r/2), and Eq.[Z] gives the configurational 
entropy for the sine-Gordon kink, Sc [4> s g] = 1-1804. We 
now proceed as before and compare these values to those 
for trial functions that approximate ^) s q(x), computing 
the configurational entropies Sc and ASc- Results are 
displayed in Table ITTj 
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a c [m] 


AE 
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Sc 


4tan~ 1 [exp(aa;)] 
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1.1804 


7rtanh[aa;] + n 


0.6087 


1.2 x 10 -3 


0.0667 


1.1017 


7r exp[ax], x < 
— 7r exp[— ax] + 2ir, x > 


0.8173 


8.3 x 10 -3 


0.3181 


1.5559 


2 tan - [ax] + tv 


1.4136 


0.1024 


0.7310 


2.0432 



J[f(x) — cj)k(x)} 2 dx. As ASc grows so does x 2 



TABLE II: Comparison of energy and configurational entropy 
of the sine-Gordon kink and several trial functions. 

Again, we see that as the energy of the approximation 
to the solution to the eom increases, so does its relative 
configurational entropy. (Although Sc for the tanh[ax] 
ansatz is off by about 6.7%, ASc correlates perfectly 
with AE and with \ 2 m ah cases.) Although we haven't 
proven that this correlation between lower energy and 
lower relative configurational entropy holds for all pos- 
sible trial functions approximating the solutions, the ex- 
amples analyzed here make for a compelling case: the 
configurational entropy offers an efficient measure of the 
ordering associated with localized energy configurations. 
Next, we extend our approach to bounces and critical 
bubbles associated with metastable decay in Id and 3d. 
We will see that not only the same correlation holds, but 
that the relative configurational entropy provides a way 
to break possible energy degeneracy between two or more 



4 



trial functions. 



CONFIGURATIONAL ENTROPY OF BOUNCES 
AND BUBBLES 

Consider a one-dimensional scalar field model with po- 
tential 

V{4>) = ^ 2 (0-20 o ) 2 -a0 o 3 , (If) 

where A and a are positive constants. For a = 0, the 
potential is a symmetric double-well as in the 4 kink 
but shifted so that its minima are at <f> = and <p = 2<fo- 
Defining <f> = 4>/<f>o, e = a/A and dropping the tildes, the 
potential can be written as 

W = ^ 2 ^ 2 -40(l + e) + 4]. (12) 

The bounce [0b o (:r)] is a static solution to the eom that 
vanishes asa;-> ±oo and reaches a maximum at x = at 
the classical turning point tp = 2[(1 + e) — (2e + e 2 ) 1 / 2 ] 
[9j. So, differently from kinks, the field itself is square- 
integrable and it's simpler to compute its configurational 
entropy than that of the energy density, which has a 
double-peak profile. (One could still do the calculation 
using the energy density.) Also differently from kinks, so- 
lutions for different values of e must be found numerically. 
The procedure, however, is the same: for each e, the 
bounce and its Fourier transform are found. Then, from 
Eq. |4j the configurational entropy Sc[4>ho] is computed. 
To compare the bounce solution with trial functions that 
approximate it, we compute the relative configurational 
entropy ASc[f,g] in two cases. A first trial function is 
the Gaussian f(x) — <fitp exp[— a(e)x 2 }, where a(e) is the 
variational parameter. Minimizing the energy with re- 
spect to a we find a c (e) = 2 v / 2[0 2 p /8 - </> tp (f + e)y/3/3 + 
y/2/2)]. Note that for very small asymmetries (thin wall 
approximation) the Gaussian is not a good trial function 
for the bounce. In Fig. [T]we can see that this is nicely re- 
flected in ASc[f,g] for the Gaussian (continuous curve) 
which grows as e — > 0. 

For a second trial function we use f(x) = 
(/>t p sech[a(e)x]. In Fig. [I] we compare the energy (in- 
sert top left) and relative configurational entropy as a 
function of e for the two trial functions. Notice that the 
energy is degenerate at td = 0.46 and that for e < [>]e<j 
the Gaussian [sech(x)] has smaller energy. However, the 
Gaussian has lower relative configurational entropy for 
all e < 0.68. At the degenerate point, the variational 
approach is ambiguous: energy considerations alone are 
insufficient to pick the best trial function there. The de- 
generacy is broken by using the relative configurational 
entropy, which clearly picks the Gaussian as the closest 
to the bounce solution at td- Should one trust the varia- 



tional approach for e > e^? According to the relative con- 
figurational entropy, only for e > 0.68. To resolve the im- 
passe, we computed the best fit x 2 ( e ) = J[f( x ) ~ i'boYdx 
for both trial functions as a function of e. The results are 
in the top right inset. For e < 0.62 (which includes e<j) 
the Gaussian is clearly a better approximation to the 
bounce. For e > 0.62, the two trial functions have com- 
parable values of X 2 ( e )- 
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FIG. 1: Relative configurational entropy ASfl(e), energy dif- 
ference AE(e) and X 2 ( e ) f° r two trial functions approximating 
the Id bounce solution. Continuous line denotes the Gaussian 
and dashed line the sech. The energy difference is degenerate 
at ed = 0.46, while the Gaussian has lower relative configura- 
tional entropy for e < 0.68. 

We repeat the computations for a 3d scalar field model 
with the same potential as in Eq. [TT] Now, the eom is 
4>" + 2<f)' /r = dV/d<fi. The spherically-symmetric critical 
bubble solution has <j>{r = 0) = <j>o, <fi'(r = 0) =0 and 
4>{r) = as v — y oo 10J . As with the Id case, we use the 
field to compute the relative configurational entropy as 
a function of the tilt e. The results are shown in Fig. [2] 
for the same trial functions used in Id and again show 
a correlation between energy minimization and ordering: 
the Gaussian has both lower energy and lower relative 
configurational entropy for all e studied. For e < 0.3, we 
can't cxtremize the energy to find a c since the critical 
bubble has a flatter profile near the origin. Other trial 
functions could be used to explore this range without 
difficulty. 

SUMMARY AND OUTLOOK 

We propose an entropic measure of ordering in field 
configuration space for nonlinear models with spatially- 
localized energy solutions. We computed the relative 
configurational entropy ASr for several trial functions 
approximating solutions to the eom for different models, 
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FIG. 2: Relative configurational entropy ASj^e) and energy 
difference AE(e) for two trial functions approximating the 3d 
critical bubble solution. Continuous line denotes the Gaussian 
and dashed line the sech. The Gaussian has lower relative 
configurational entropy and energy for all e probed. 

showing that higher ASr correlates with higher energy: 
solutions to the eom tend to be the most ordered, given 
their specific dynamic constraints. In cases where there 
is a degeneracy in the energy of trial functions, ASr can 
be used as a discriminant. In forthcoming papers we will 
extend our approach to nonequilibrium field theory and 
cosmology. Our measure can be extended to models in- 
cluding gravity and gauge fields, and could potentially be 
used to discriminate between solutions in the superstring 
landscape [TT] . 
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